Real-time decoding of question-and-answer speech dialogue using human cortical activity

DECODING OF TEMPORAL INTERVALS FROM CORTICAL ENSEMBLE ACTIVITY Abbreviated Title: Time Decoding from Cortical Activity

Neurophysiological, neuroimaging and lesion studies point to a highly distributed processing of temporal information by cortico-basal ganglia-thalamic networks. However, there are virtually no experimental data on the encoding of behavioral time by simultaneously recorded cortical ensembles. We predicted temporal intervals from the activity of hundreds of neurons recorded in motor and premotor ...

Question and answer database optimization using speech recognition results

The aim of this research is a human-oriented spoken dialog system which provides replies to a variety of users’ utterances. The example-based response generation method searches a question and answer database (QADB) for the example question most similar to a user utterance. With this method, the system can answer a question difficult for a model to express. A QADB is constructed from question a...

A Question and Answer Session on the Meaning of Being Human , with Dr. Gholamreza Aavani

An efficient decoding method for real time speech recognition

In this paper, we describe approaches for improving the search efficiency of a dynamic programming based onepass decoder for dialogue applications. In order to allow the use of long-term language models (LM) and crossword acoustic models, efficient pruning techniques and fast methods for the calculation of emission probability density functions (pdfs) are required. This is particularly importan...

A Flexible Question-and-Answer Task for Measuring Speech Understanding

This report introduces a new speech task based on simple questions and answers. The task differs from a traditional sentence recall task in that it involves an element of comprehension and can be implemented in an ongoing fashion. It also contains two target items (the question and the answer) that may be associated with different voices and locations to create dynamic listening scenarios. A se...